3D Face Modeling based on 3D Dense Morphable Face Shape Model
نویسنده
چکیده
Realistic 3D face model is more precise in representing pose, illumination, and expression of face than 2D face model so that it can be utilized usefully in various applications such as face recognition, games, avatars, animations, and etc. In this paper, we propose a 3D face modeling method based on 3D dense morphable shape model. The proposed 3D modeling method first constructs a 3D dense morphable shape model from 3D face scan data obtained using a 3D scanner. Next, the proposed method extracts and matches facial landmarks from 2D image sequence containing a face to be modeled, and then reconstructs 3D vertices coordinates of the landmarks using a factorization-based SfM technique. Then, the proposed method obtains a 3D dense shape model of the face to be modeled by fitting the constructed 3D dense morphable shape model into the reconstructed 3D vertices. Also, the proposed method makes a cylindrical texture map using 2D face image sequence. Finally, the proposed method generates a 3D face model by rendering the 3D dense face shape model using the cylindrical texture map. Through building processes of 3D face model by the proposed method, it is shown that the proposed method is relatively easy, fast and precise. Keywords—3D Face Modeling, 3D Morphable Shape Model, 3D Reconstruction, 3D Correspondence.
منابع مشابه
3D Dense Correspondence for 3D Dense Morphable Face Shape Model
Realistic 3D face model is desired in various applications such as face recognition, games, avatars, animations, and etc. Construction of 3D face model is composed of 1) building a face shape model and 2) rendering the face shape model. Thus, building a realistic 3D face shape model is an essential step for realistic 3D face model. Recently, 3D morphable model is successfully introduced to deal...
متن کاملSHREC'08 entry: Shape based face recognition with a Morphable Model
We present a method for face recognition by fitting a 3D Morphable Model to shape data. Fitting is done with a a robust nonrigid ICP algorithm. For recognition, it is possible to use either the fitted model parameters, or the correspondences induced by the model. We compare different similarity measures, and show that a 3D Morphable Model allows very robust retrieval results.
متن کاملA Multiresolution 3D Morphable Face Model and Fitting Framework
3D Morphable Face Models are a powerful tool in computer vision. They consist of a PCA model of face shape and colour information and allow to reconstruct a 3D face from a single 2D image. 3D Morphable Face Models are used for 3D head pose estimation, face analysis, face recognition, and, more recently, facial landmark detection and tracking. However, they are not as widely used as 2D methods t...
متن کاملDisentangling Features in 3D Face Shapes for Joint Face Reconstruction and Recognition
This paper proposes an encoder-decoder network to disentangle shape features during 3D face reconstruction from single 2D images, such that the tasks of reconstructing accurate 3D face shapes and learning discriminative shape features for face recognition can be accomplished simultaneously. Unlike existing 3D face reconstruction methods, our proposed method directly regresses dense 3D face shap...
متن کامل3D Morphable Model Fitting to Image Sequences
This paper outlines a new method to fit 3D Morphable Models (3DMM’s) from sets of 2D image features. It is the extension of a popular correspondence 3D shape fitting from 2D feature point method which allows it to be applied to video sequences. For shape estimation this paper focuses on strictly linear solutions to the problem of shape fitting to image sequences. In doing so we introduce a Shap...
متن کامل